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-- The MAILING DATE of this communication appears on the cover sheet with the correspondence address ~ 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment See 37 CFR 1.704(b). 

Status 

1 )^ Responsive to communication(s) filed on 6/25/04 . 
2a)S This action is FINAL. 2b)Q This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 21-41 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) 13 Claim(s) 21-41 is/are rejected. 

7) Q Claim(s) is/are objected to. 

8) \3 Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1 .121 (d). 
1 1 )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-1 52. 

Priority under 35 U.S.C. § 119 

12)D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. Q Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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1) ^ Notice of References Cited (PTO-892) 4) □ Interview Summary (PTO-413) 

2) □ Notice of Draftsperson's Patent Drawing Review (PTO-948) Paper No(s)/Mail Date. . 

3) □ Information Disclosure Statement(s) (PTO-1449 or PTO/SB/08) 5 ) □ Notice of Informal Patent Application (PTO-152) 

Paper No(s)/Mail Date . 6) □ Other: . 
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DETAILED ACTION 

1 . This action is responsive to communications: amendment filed on 6/25/04 to the 
application filed on 12/30/99. 

2. Claims 21-41 are pending in the case. Claims 21 , 28, 35 are independent 
claims. 

3. The objection of claim 21 has been withdrawn in view of the amendment. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 21-41 remain rejected under 35 U.S.C. 103(a) as being unpatentable 
over McDade et al. (US Pat No. 6,490,324 B1, 12/3/02, filed 12/8/98) in view of Tillman 
et al. (US Pat No. 6,496,980 B1, 12/3/02, filed 12/7/98). 

Regarding independent claim 21, McDade discloses: 

- selecting from the digital video stream, a particular one of the digital video frames 
for synchronizing (col 11, line 60 to col 12, line 19: selecting a desired sequence 
form the video and audio stream for synchronizing the video and audio in the 
proxy filter) 
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- selecting from the digital video stream, others of the digital video frames 
associated with the digital video frame to be enhanced (col 1 1 , lines 7-24: the 
picture decoding and the sub-picture decoding suggest that the sub-picture 
frames are associated with the video frame; col 13, lines 3-25: the fact that the 
frames are encoded based on the past and future frames implies an association 
between a particular frame and other video frames; since McDade discloses 
selecting a particular frame for synchronizing and the association between the 
other video frames and the selected video frame, selecting other frames 
associated with the selected frame for synchronizing is suggested when selecting 
a video frame for synchronizing) 

McDade does not disclose: 

- enhancing the selected video frame based upon information included in the other 
digital video frames and the particular digital video frame 

Tillman discloses: 

- enhancing the selected video segment by providing a larger image for the 
selected video segment (col 7, lines 19-50, col 10, line 57 to col 1 1 , line 15, 
figure 4) 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
was made to have combined Tillman into McDade since Tillman discloses enhancing 
the selected video segment with the enlarged image providing the advantage to apply to 
the selected video frame in McDade for improving the image quality of the selected 
portion of the video based upon the information of the selected portion of the video and 
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the other frames associated with it beside rendering the desired result of synchronizing 
of video and audio data. 

Regarding claim 22, which is dependent on claim 21 , McDade discloses: 

- obtaining movement information for the selected digital video frame and the other 
digital video frames (col 3, lines 32-55: the set of motion compensation 
instructions is included in the encoded video frames used for decompressing) 

Regarding claim 23, which is dependent on claim 22, McDade discloses: 

- identifying portions of the associated digital video frames corresponding to the 
portion to be synchronized (col 1 1 , lines 7-39: the sub-pictures are portions of the 
video frames associated with the selected portion) 

McDade does not explicitly disclose: 

- enhancing the selected video frames based upon information included in the 
other digital video frames and the particular digital video frame 

Tillman discloses: 

- enhancing the selected video segment by providing a higher quality image with 
the larger image (col 7, lines 35-50, col 10, line 57 to col 1 1, line 15) 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
was made to have combined Tillman into McDade since Tillman discloses enhancing 
the selected video segment by providing larger image to a user thus motivating to 
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incorporate in McDade for producing a higher quality of image of the selected video 
along with the good result of synchronizing video and audio data as in McDade. 

Regarding claim 24, which is dependent on claim 22, McDade does not explicitly 
disclose: 

- selecting another of the stream of digital video frames for enhancement when the 
enhancement is complete 

- continuing the selecting until all of the selected digital video frames, or portions 
thereof, have been enhanced 

Instead, McDade discloses manipulating selected ones of the enhanced digital video 
frames (col 11, lines 25-39; col 9, lines 26-57). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to have modified McDade to include the above steps since the fact 
that manipulating the selected ones of the digital video frames, which is considered as 
an enhancement of the encoded video frames, is performed for each of the video data 
streams and continues to perform for all of the selected video frames. 

Regarding claim 25, which is dependent on claim 24, McDade and Tillman discloses 
manipulating selected ones of the enhanced digital video frames (McDade: col 11, lines 
25-39; col 9, lines 26-57; Tillman: col 7, lines 35-50, col 10, line 57 to col 11, line 15). 
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Regarding claim 26, which is dependent on claim 22, McDade does not explicitly 
disclose that manipulating is selected from a group comprising: a zoom operation, a 
contrast enhancement operation, a luminance control operation, a color adjustment 
operation, a gamma correction operation, an image sharpening operation, and a color 
saturation operation. 

Tillman discloses manipulating is selected from a group comprising: a zoom operation, 
a contrast enhancement operation, a luminance control operation, a color adjustment 
operation, a gamma correction operation, an image sharpening operation, and a color 
saturation operation (col 10, line 57 to col 11 , line 15: enhancing a selected video can 
be done by providing smoother images, larger images, clearer images where providing 
larger images is a zoom operation). 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
was made to have combined Tillman into McDade since Tillman provides the zoom 
feature for enhancing a selected video thus motivating to incorporate into McDade for 
providing higher quality images to users instead of merely synchronizing a selected 
video. 

Regarding claim 27, which is dependent on claim 26, McDade discloses that the 
method is executed by a processor unit included in a digital video disc (DVD) player 
(figure 2; col 9, line 57 to col 10, line 35). 
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Claims 28-41 are for a computer program product and an apparatus of method claims 
21-27, and are rejected under the same rationale. 



Response to Arguments 

6. Applicant's arguments filed 6/25/04 have been fully considered but they are not 
persuasive. 

Applicants argue that Tillman does not discloses using data from the same video stream 
to enhance the video frames as in the invention since in Tillman, "the inhancement 
video frame is part of another video data stream that corresponds one to one (as in 
FIG.3) to video frames in the base layer and therefore is a different video stream than 
the base layer" whereas it is clear that in order to enlarge a particular video frame, only 
video data that corresponds to that particular video frame can be used and no other 
(Remarks, page 7). 
Examiner respectfully disagrees. 

In Tillman, the same digital video stream is used to enhanced the particular video frame 
using different layers (see figure 3). The same video stream feature is also shown in 
figure 4 and col 7, lines 19-50 where enhancement is applied to the same frame to 
enlarge the same video data . 
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Conclusion 

7. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 . 1 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

8. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Zdepski et al. (US Pat No. 5,886,733, 3/23/99, filed 5/17/96). 

Boyce (US Pat No. 5,923,814, 7/13/99, filed 8/15/97). 

Abecassis (US Pat No. 6,408,128 B1, 6/18/02, filed 11/12/98). 

Abecassis (US Pat No. 6,553,178 B2, 4/22/03, filed 9/8/94). 

van der Schaaret al. (US Pat No. 6,501,797 B1, 12/31/02, filed 7/6/99). 

Florencio et al. (US Pat No. 6,549,577 B2, 4/15/03, filed 9/25/98). 

Ketcham (US Pat No. 6,704,357 B1 , 3/9/04, filed 9/28/99). 

Yeadon et al., Supporting Video in Heterogeneous Mobile Environments, ACM 1998, 
pages 439-444. 
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9. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Cong-Lac Huynh whose telephone number is 571-272- 
4125. The examiner can normally be reached on Mon-Fri (8:30-6:00). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Stephen Hong can be reached on 571-272-4124. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-4125. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



Cong-Lac Huynh 
Examiner 
Art Unit 2178 
06/09/05 




